🕷️️ Job Radar • SCRAPING

upwork.com 2026-04-22 🟡

🔹 Substack Scraper
👤 Client: 🇦🇪 United Arab Emirates Member since 2026-04-20
💰 Price: ****
🚩 Problem: Gather a list of Substack creators with high subscriber counts.
📦 Existing: Not specified

Specifications:

[Target] Identify Substack creators based on subscriber count and engagement metrics.
[Method] Use web scraping techniques to collect data from public profiles.
[UI/UX] Not applicable for this task.
[Stack] Python, BeautifulSoup, Selenium, Pandas, Google Sheets or Excel
[Security] Ensure compliance with Substack's terms of service; use proxies and rotate IP addresses if necessary.
[Format] Deliver data in a clean, structured format (Google Sheets/Excel)

Workflow:

Define the criteria for selecting Substack creators (2,000+ subscribers as primary, 1,500+ as fallback).
Set up web scraping tools and scripts to collect first name, last name, LinkedIn URL, company/personal website, and subscriber count.
Test the scraper on a small sample of profiles to ensure accuracy and compliance with legal requirements.
Scrape data from 10,000+ Substack creators, ensuring no duplicates are included in the final dataset.
Clean and validate the collected data for high accuracy before delivering it in Google Sheets or Excel.